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ABSTRACT 


By  means  of  elementary  properties  of  the  absolute  value 
function,  important  properties  of  a  special  class  of 
"constrained  generalized  median”  problems  (and  eventually, 
the  most  general  class,  vide  Charnes,  Cooper,  Thompson) 
such  as  existence  of  solutions,  gradient  and  incremented 
formulae,  linear  programming  and  probabilistic  interpre¬ 
tations  are  obtained  for  all  classes  of  joint  distribution 
functions  for  which  the  problems  make  sense.  Results  of 
A.  C.  Williams  and  R.  Wets  obtained  by  involved  arguments 
and  sophisticated  constructs  appear,  when  corrected,  as 
special  instances  of  some  of  the  above  results  but  devoid 
of  the  interrelations  and  interpretations  herein  adduced. 
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1.  Introduction 

Recently  the  SIAM  Journal  has  published  two  papers  [l,  8]  which  present 
elaborate  classifications  and  sophisticated  constructions  for  two  classes  of 
problems  in  probabilistic  programming.  Neither  the  authors  of  these  papers, 
nor  their  referees,  appear  to  have  recognized  that  the  problem  in  [l]  and  the 
problems  in  [8]  (for  example,  the  "complete"  problem)  are  very  special  in¬ 
stances  of  the  class  of  "constrained  generalized  median"  problems  first  discus,1 
by  Charnes,  Cooper  and  Thompson  in  1961. This  canonical  "median"  formule 
tion  is  not  a  matter  of  a  choice  of  nomenclature.  Its  technical  advantage  in  mar- 
problems  in  probabilistic  programming  derives  from  bringing  into  immediate 
focus  the  relevance  of  the  absolute  value  function. 

As  we  shall  demonstrate  below  by  means  of  the  absolute  value  function  we 
easily  (1)  obtain,  characterize  and  markedly  extend  the  essential  results  of  [l], 
(2)  interpret  these  results  in  linear  programming  and  probabilistic  terms,  (3) 
develop  gradients  and  directional  derivatives  and  interpret  probabilistically 
incremental  formulae  in  all  generality,  (4)  place  these  results  in  the  framework 
of  chance- constrained  programming,  and  (5)  reduce  all  cases  to  investigation  of 
the  behavior  of  the  objective  function  along  a  ray. 

Before  undertaking  these  developments  and  in  order  not  to  interrupt  them 

some  important  assertions  and  constructions  in  [l]  require  correction.  The 

problem  in  [l]  is  to  choose  a  vector  X  ^  0  which  maximizes  the  expected 

T  m 

value  of  the  function  p  X  +  S  g-  (X,b), 

i=l  1 


—f  See  reference  [4) 
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where  ,  * 

f(b  -  alX)  Yl  if  b  .-«lX<'J 

(1)  g.CX.b)  -  >  i  i 

1  /  (bi  -  alX)  6t  if  bt  -  alX  >  0, 

end 

Here  ai,t«l...m>  is  the  ith  row  of  a  given  mxn  matrix  A, 

Y^  and  fl  -,i«l...m,  are  given  constants, 

T 

p  is  a  given  lxn  vector, 

and  b^,i*l, . . .  ,m,  are  random  variables  whose  marginal  distributions 
are  known. 

Thus  the  problem  is 

T  m 

max  E(p  X  +  £  g.(X,b)) 

i-1  1 

(2)  subject  to  X  >  0, 

where  we  compute  the  expectation  using  the  joint  distribution  of  the  random  vari¬ 
ables  b, , . . .  ,b  . 

1*  m 

In  (2),  it  is  assumed  that  the  vector  X  is  to  be  selected  before  any  ob¬ 
servations  are  made  on  the  random  variables  b^ , i«=l , . . .  ,m.  Thus  X  is  not  per¬ 
mitted  to  be  a  function  of  these  random  variables,  but  rather  it  must  be  a  determin¬ 
istic  vector.  Such  a  vector  of  decision  rules  is  called  a  zero  order  decision  rule 
in  the  customary  terminology  of  chance-constrained  programming.—^  Thus,  (2)  is  a 
chance-constrained  programming  problem  in  which  the  chance  constraints  are  of  the 
particularly  simple  form  P  (X  >  0)  >  1,  in  which  the  function  whose  expectation 
we  wish  to  maximize  is  a  piecewise  linear  function  of  the  vector  of  decision  rules, 
and  in  which  we  seek  the  optimal  zero  order  rule. 

1/ 

—'For  results  on  zero  order  rules  see  references  [2,  3,  4,  5,  6], 
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In  the  mathematical  development  presented  in  section  2,  we  first  show  that 
(2)  can  be  converted  into  a  constrained  generalized  median  problem  of  the  type 
discussed  in  [4].  This  transformation  enables  us  to  use  standard  linear  program¬ 
ming  methods  in  obtaining  our  results.  It  also  permits  us  to  indicate  how  these 
results  can  be  extended  in  two  important  directions:  one  is  the  case  in  which 
g^(X,b)  is  a  piecewise  linear  function  of  b^,  ,..,bm  rather  than  only  b^ 
as  it  is  in  (1);  the  other  is  the  case  in  which  X  is  subjected  to  other  linear 
constraints,  say  DX  >  d,  in  addition  to  the  constraints  X  >  0.  Neither  of 
these  extensions  are  discussed  in  [1],  and  the  techniques  used  in  [1]  cannot  be 
readily  extended  to  include  these  cases. 

The  main  results  in  [1]  are  a  pair  of  theorems  which  give  necessary  and 
sufficient  conditions  for  the  existence  of  an  optimal  solution  to  (2).  We  will 
obtain  most  of  these  conditions  in  a  much  more  direct  manner  than  was  used  in 
[1].  In  particular,  our  proofs  will  require  only  well-known  theorems  in  linear 
programming  and  some  elementary  inequalities  on  the  absolute  value,  and  will  not 
require  concepts  such  as  Kakutani's  fixed  point  theorem  which  were  used  in  [1]. 
Neither  will  we  require  the  elaborate  specifications  and  restrictions  of  the 
classes  of  probability  distributions  as  used  in  ClJ. 

One  result  obtained  in  [1J  characterizes  the  situation  in  which  the  objective 
function  of  (2)  is  bounded  from  above,  but  the  supremum  of  the  function  is  not 
attained  for  a  finite  X.  Rather  than  deriving  this  particular  result,  we  character¬ 
ize  this  situation  in  a  constructive  way  by  showing  that  it  can  be  related  to 
the  behavior  of  the  objective  function  along  a  particular  ray  and  by  obtaining  an 
explicit  expression  for  its  limiting  value. 
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First,  however,  we  must  correct  some  assertions  in  [1]  about  the  admissible 
class  of  random  variables.  In  [1]  it  is  assumed  that  F^,  the  cumulative  dis¬ 
tribution  function  of  b^,  has  at  most  a  finite  number  of  discontinuities  in 

l 

each  finite  interval.  In  our  development  in  section  2  it  will  be  clear  that  such 
an  assumption  is  never  requiredj  when  dif ferentialability  is  not  the  main  focus. 
We  can,  for  example,  admit  random  variables  whose  distribution  function  has  pro¬ 
bability  mass  at  ail  the  irrational  paints  in  an  interval  (or  on  the  real  line). 

It  is  also  assumed  in  [1]  that  F^( • ) ,i=l , . . .m,  satisfies  the  following  con¬ 
ditions  : 


and 


3(a) 


3(b) 


lim  z1f‘i(*1)  -  0, 

Zj-»-0D 


ziC1-Fi(zi)J  -  0. 


A  remark  is  then  made  [l,  p.  930]  to  the  effect  that  3(a)  and  3(b)  are  "sufficient 
for  (but  slightly  stronger  than)  the  existence  of  the  first  moment  of  F^(*)," 

In  actual  fact,  as  we  prove  in  theorem  2, 3(a)  and  3(b)  are  necessary  for  the  exist¬ 
ence  of  the  first  moment  of  F^(')»  but  they  are  not  sufficient.  This  can  be 
seen  by  the  following  example: 


Let  F(z) 


1, 


z  >  -  e 


1*1  In  z I 


z  <  -  e 


Then 


lim 
z  — 


zF  (z) 


lim 

z  — 


i“i*I 


and 


liipm  z[l-F(z)]  ■  0,  as  F(z)  «  1  for  z  >  -  e 


Hence  F(z)  satisfies  conditions  3(a)  and  3(b).  However,  F(z)  does  not  have  a 
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first  moment  since 


J*"  zdF(r) 


e 


dz 


i±M»L-  dz 

z[ln(z)]Z 


z[ln(z)]" 


dz  +  e 


ln(ln(e))  -  £  1  im^  £ln(ln(t))J 


■  -  «,  since  the  integral  term  is  negative  and  tHm+o>[ln(ln(t))]  ■  ».  Thus  E(z) 
does  not  exist. 

Conditions  3(a)  and  3(b)  are  used  repeatedly  in  [l]  to  guarantee  that  the  in¬ 
tegration  by  parts  formula 

X  X 

J*  Ft(z)  dz  «=  xFt(x)  -  zlira_w  zF^z)  -  J*  zdFt(z) 

••  *• 

is  valid.  But  the  above  example  shows  that  conditions  3(a)  and  3(b)  are  not  suf¬ 
ficient  to  guarantee  the  validity  of  this  integration  formula  since  both  integrals 
diverge.  On  the  other  hand,  the  existence  of  E(z)  is  certainly  a  sufficient 
condition  for  the  formula  to  be  meaningful. 


2.  Mathematical  Development 

We  begin  by  introducing  some  notation.  Let  Y  be  an  n-vector. 

Then  l*T|  -  <|yxl »  •••.  |yj.  •••,  |yn|) 

and 

e|y  |  *  (E|y^|  i  ...»  E|y^| ,  ...»  e | ynl ) • 

| | Y | |  to  denote  the  norm  of  Y. 


We  will  use 
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From  the  definition  of  g^(X,b)  in  (1)  we  have  that 

4j  j  i  \  Vj  /  . 


8i(X,  b)  -  ^  (jbt  -  ah\  +  <bt  -  a*X)^  +  ^  (o>t  -  aAX)  -  |bt  -  alx|)  . 

Hence 

^(g^x,  b>)  -(^4^)  ^(b,)  -  (-4-^)  •** + (4f~)  Eibi  -  ai*i 


e/pTX  +  S^x,  b)^  .  PTX  +  Z^  E^gl(X,  b)^  .  Z^  (  -1  2  E<b1) 


+(pt .  I  (\±h)  ^  x  +  jx(^)  «|bt  -  .*x|  . 

Thus,  dropping  the  constant  term  £  (  - - -  )E(b.)  from  the  objective  function, 

i-1  \  1  /  1 


(2)  can  be  written  as 


min  h(X)  -  cTX  +  aTE|b  -  Ax| 


where 


subject  to  X  ^  0 

m  /V  +  Vj.' 


cj  ‘  JA~ 


“u  ‘  py  J " x*  •••• "  * 


Yi  "  fli 

Oc  t  *  m  ,  i  -  1,  •  •  •  ,  m  • 


Also  >  0  as  we  are  given  that 

(4)  is  a  constrained  generalized  median  problem  of  the  type  discussed  in  [4]. 

The  constraints  are  of  the  particularly  simple  form  X  >  0. 

We  first  note  that 

Theorem  1:  h(X)  is  finite  for  some  X  >  £,  in  which  case 

h(X)  is  finite  for  all  X  >  0,  if  and  only  if  E | b^ |  <  oo  for 
all  i  such  that  >  0  (i.e.  >  6^). 

Proof :  Using  the  well-known  and  elementary  inequalities  on  the  absolute  value 

we  have  that 

| AX |  -  | b |  <  |b  -  AX|  <  | b |  +  | AX | 
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and  ao  applying  the  expected  value  operator  (which  is  order-  pre¬ 
serving)  lo  both  sides  of  the  inequalities  we  get 

(cTx  t  o.T|ax|)  aTE|b|  <  h(X)  <  (cTx  +  aT|Ax|)  +  aT E | b |  . 

This  establishes  the  sufficiency  and  necessity  of  the  stated 
conditions: 

Theorem  2:  A  necessary  condition  for  E | |  <  oo  is  that 


lim 

t->ao 

tp( 

l-J  i 

-  0 

Proof: 

Let 

Xt 

1 

1 

[>•  l-J 
M 

<  t 

>  t 

Then  E|bJ  -  Etfbjx^  +  ^|bj(l  -  . 

But  by  definition  of  the  Lebesgue-Stielt jes  (or  Radon)  integral, 

E|bjJ  ■  lim  E ( | b ^ | xt )  when  E [ b^|  <  oo  . 
t+oo 

Thus  E  ^ | b^ |  <1  -  Xt)^  — >  0  as  t  — >  ®  . 

But  E  ^IbJ  (1  -  Xt)  )  -  J*  |  t>t| drt(bt)  >  tp  ^  lbtl  >  tj  >  0  for  t  >  0. 

So  when  E | b^ |  <  oo  we  have  tP^|b^|  >  t|-*0  as  t— »-oo  . 

To  see  that  the  condition 

lim  tP  (  |b  |  >  tl  -  0 

t-**+CD  ^  1  “  ' 

is  equivalent  to  3(a)  and  3(b),  note  that 

P  {  |bj  >  -  P(bt  >  t)  +  P(bi  < -t)  -  1  -  Pt(t)  +  Ft(-  t). 

Hence  we  have  0  -  lim  (  t[l  -  F  (t)]  +  tF  (-  t)  j  , 
t-**+®  \  1  1  ' 

and  since  F^(  )  is  a  nonnegative  function,  3(a)  and  3(b)  immediate¬ 
ly  result. 
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Theorem  3 


Proof: 


h(X)  is  bounded  from  below  for  all  X  >  0  if  and  only  if  Chere 
exists  a  w  satisfying 

|v|  <  a 
wTA  +  cT  >  0. 


By  virtue  of  the  inequality 

cTX  +  aT|Ax|  -  aTE|b|  <  h(X)  <  cTX  +  aT|Ax|  +  aTE|b| 

obtained  in  the  proof  of  theorem  1,  it  is  enough  to  show  that 

cTX  +  aT|AX|  is  bounded  from  below  for  all  X  >  0  if  and  only  if 

X  X 

there  exists  a  w  satisfying  |w|  <  a  and  wlA  +  c  >  0. 

To  do  this,  we  first  note  that  the  problem 

^  min  cTX  +  aT|AX| 

subject  to  X  >  0 

can  be  rewritten  in  the  following  linear  programming  form: 

min  cTX  +  aT(Y+  +  Y_) 
subject  to  Y+  -  Y*  -  AX  =  0 
X,  Y+,  Y"  >  0  . 


The  dual  to  this  problem  is 

max  w 
subject  to 


T.  ^  T 

-  w  A  <  c 

T  ^  T 
w  <  a 

T  T 

-  w  <  a 


or 


T 

max  w 
T  T 

subject  to  w  A  +  c 


0 

>  0 


|w|  <  a  . 
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Since  (S)  Is  consistent  (the  origin  is  feasible),  the  extended  dual 
theorem  of  linear  programming  (see  [7],  vol.  I,  p.  190)  states  that 
the  objective  function  of  (5)  is  finite  if  and  only  if  there  is  a 
feasible  solution  to  its  dual,  i.e.  (6).  Thus  the  theorem  is  proved. 

To  convert  the  result  of  theorem  3  to  the  corresponding  result  in  [1],  we  use 


Y<  - 


T  Ti  i  it 

our  definitions  of  c  and  a.  Since  a.  ■  - ^ -  ,  we  see  that  |w  <a 

f'Ti  +  'i'S 

ni  ■  wi  +  (  - - - J  ,  then  the 


*  Yt  Yt  '  «! 

means  - 2 -  <  w^  <  - - -  .  If  we  put 


condition  JwJ  <a  becomes  6^  -  ni  -  Y^ •  Similarly,  since 

m  /®i  +  Y^^N  T  T  T  T  T  T 

Cj  ■  £  - - - J  -  p  j ,  we  get  that  wA  +  c  ■  tt  A  -  p  ,  so  wA  +  c  >0 

T  T 

becomes  tt  A  >  p  .  Thus  we  see  that  theorem  3  is  analogous  to  the  result  in  [1] 
which  says  that  the  optimal  value  of  the  objective  function  to  (2)  is  finite  if  and 
only  if  there  exists  an  m-vector  tt  satisfying 


and  &  <  tt  <  y  • 

We  not  turn  to  an  elucidation  of  what  is  termed  in  [l]  the  "insoluble—^ 

finite”  case.  This  is  the  situation  we  mentioned  in  the  introduction  in  which 

h(X)  is  bounded  from  below  but  its  infimum  is  now  attained  for  a  finite  X,  i.e. 

h(X)  >  inf  h(X)  for  all  X  >  0. 

X>0 


Theorem  4: 


As  t->oo  , 


•  tq|  ~ 


tq  -  E(b1),  q  >  0 
E(bi)  -  tq,  q  <  0 
E|bJ  .  q  -  0, 


where  we  use  the  symbol  ^  to  mean  that  the  difference  between  the 
two  quantities  tends  to  zero  as  t — *-oo  . 


~^This  terminology  is  peculiar  since  not  only  is  it  not  insoluble  but  we  here 
explicitly  write  down  the  optimal  value  of  the  objective  function  for 
this  case.  This  is  done  in  the  corollary  to  theorem  4. 
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Proof: 


Define  the  function  ^tq  xtq(b^)  ■  (l»  b^  <  tq 

0,  bi  >  tq  . 

Then  -  tq|  -  E^-  tq) (1  -  Xtq>]+EC(t<l  “  bt)Xtq] 

-^E(bi)  -  2E(biXt.q)^  +  tq[P(b1  <  tq)  -  P(bt  £  tq)]. 
But  E^biXtq)^(  0>  q  <  0  as  t — bco  , 

(E(bi)>  q  >  0 

and  the  second  term  on  the  right  approaches  tq  if  q  >  0  and 
-  tq  if  q  <  0.  Thus  the  theorem  is  proved. 

Now  fix  X  and  define  1^  =  |^i  :  a^X  *  0^  .  Let  b^  ■  -  b^  sgn  (a*X) 


and  b 


b  ,  i€  I  .  Then  we  have 


0  ,  iji 


Corollary:  As  t— >co  ,  h(tX)~  t[c^X  +  q^|AX|]  +  aT[E(b*)  +  E  |  b^  [  ] . 

Proof :  h(tX)  *  tcTX  +  aTE|b  -  tAx|  /v  tc  X  +  £  ~p..  E|bJ 

iel  1 

+  E  0  a.  sgn  (aiX)[ta1X  -  E(b  )] 
i^I 

m  t[cTx  +  aT |ax|  ]  +  cJfXb1)  +  e|  b2 1  ]  . 

Theorem  5:  Suppose  that  h(X  ) — >v^  for  some  sequence  M 


with 


X  >0,  fix  1 1 — >oo  as  n — ►■od  ,  where  vn  »  inf  h(X). 
n  -  1 1  n1 '  0  y^.o 


Then  c  Y  +  a  |  AY  |  =  0  for  some  Y  >  0  with 


X>0 

Y  |  |  -  1. 


Proof : 


Since  the  set  S 


n 


l  ;  ^X:  |  |x| |  -  1,  X  >  oj  is  compact,  the  set 


|  | x  j  [  j  bas  a  P°int  Y  in  S^.  Moreover,  there  exists  some 

subsequence,  which  we  denote  by  ^ Y^  ,  such  that  X  — 
n — >  CD  . 


Y  as 
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(7) 


Now 

1 


-  (cTX  +  aT|AX  |)«  cTY  +  Cl1 1  AY  |  ->  cY  +  aT|AY|  as  n  ■>  “  . 
lixjl  a  "  n 

However,  c^X  +  Cl^IaX  |  is  bounded  from  below  since  h(X  )  >  v_. 

n  n  '  n'  0 

This  follows  from  the  inequality  (c^X  +  Cl^|ax|)  -  Ct^E  |  b  |  <  h(X) 

<  (cTx'+  clT | AX | )  +  olTE | b  1 .  Thus,  in  particular,  cTXn+aT|AXn| 


n 


remains  bounded  while  ||  X  ||  ®.  Hence,  from  (7),  we  conclude 

n 

T _  T  I  —| 

that  the  left  hand  side  goes  to  zero  while  c  Y  +  Cl  |AY|  >  0. 

Thus  the  theorem  is  proved. 

Theorem  6: 

A  necessary  and  sufficient  condition  that  lim  h(tX)=  inf  h(tX)  is  that 

t  -r  t  ^0 

T  T  i  l 
c  X  +  aA  I  AX  |=0. 

Proof:  Assume  ||X|i  =  1  since  the  conclusion  is  trivial  for  X=0  and 

T  Til  T  T l  I 

c  X  +  OL  |  AX  |  is  positive  homogeneous.  Suppose  c  X  +  cl  |  AX  |  =0.  The 

Corollary  to  Theorm  4  guarantees  that  1  im  h(tX)  =  lim  t  [cTX  +  CtT  j  AX  |  J -t- 


t-? 


C.^Eb^+  OlTE  |b^  I  ,  so  that  the  facts  that  cTX  +  Cl^|ax|=0  and  that  E  |  b .  |  <  00 

ii>  i 

for  all  i  prove  that  lim  h(tX)  exists  and  is  finite.  Now  suppose  that 

t  00 

there  is  a  t  such  that  inf  h(tX)=  h(t  X).  Since  h(tX)  is  a  convex  func- 
°,  ,  t  2°.  ° 

tion  of  t,  h(-t  X+  —  tX)  ^  —  Lh(t  X)+  h(tX)J  for  all  t.  But  lim  h(tX)  = 

i.  O  l  L  O  j-_j,  oo 

lim  h^t  X  4-  -^-tX)  =  v  ,  so  that  v  ^  —  h(t  X)+  ^  v  ,  or  v  ^  h(t  X)  .  Since 
.  _  s2o  2  o  o  2  '  o  '  2  o  oNo 

h(t  X)^v  by  definition  of  t  ,  we  have  shown  inf  h(tX)=  h(t  X)=v  = 
vo/o  o  tSQv/vo/o 

lim  h(tX)  when  t  exists:  if  there  is  no  such  t  than  a  fortiori 
t-7>  00  0  O 

inf  h(tX)  =  lim  h(tX). 
t^O  t->  00 


To  prove  the  converse,  note  that  if  X^=  t^X  for  some  sequence  having 
X 

t  ->°°,  than  — — —  =  X  for  all  n.  Theorem  5  then  immediately  yields 
the  desired  results. 

We  cast  the  following  evident  observation  as  a  theorem  because  of 
its  practical  utility: 
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Theorem  7:  inf  h(X)  =  inf  inf  h(tX). 

X^O  ||X||*1  t^O 

The  usefulness  of  this  observation  rests  on  Theorem  6.  In  appli¬ 
cations  it  may  happen  that  there  is  only  one  X  with  ||x|j  =  1  for  which 
c  X  +  CL  | AX |  ■=  0.  In  cases  such  as  this,  Tneorem7  shows  that  one  can 
approximate  the  value  of  v^  as  closely  as  desired  at  some  finite  X  by 
considering  only  ray  minima  for  rays  tX  with  X  sufficiently  near  X  . 

However,  it  should  be  expressly  noted  that  these  "knife-edge" 
infinite  ray  cases  can  never  appear  as  solutions  to  practical  problems. 
Rather  they  exhibit  an  inadequacy  of  realistic  formulation  of  the  model. 
We  develop  their  properties  here  only  for  completeness  of  analysis. 

We  now  turn  to  the  development  of  incremental  formulae  and  their 
interpretation  in  probabilistic  terms.  It  should  be  noted  that,  again, 
elementary  properties  of  absolute  values  quickly  and  naturally  lead  to 
results  in  all  generality. 
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3 .  The  Increment  and  the  Radial  Directional  Derivative  of  h(X). 

We  now  give  expressions  in  terms  of  the  probabilities  of  the  various  b 

versus  AX  events  for  the  increment  of  h(X)  (i.e.,  h(X  +  5)  "  hQO  )  and 

for  the  directional  derivative  h(tX)  whenever  the  latter  exists.  The  ex- 

dt 

pressions  are  free  of  any  restrictions  as  to  the  character  of  the  distributions 
of  the  b. 

First,  on  inspecting  figure  1  below,  we  note  that,  for  e  >  0, 

(  e  ,  u  <  a 

f(u)=  | u  -  (a  +  e)|  -  |u  -  a|=  je  +  2(a  -  u),  a  <  u  <  a  +  €- 

,  u  >  a  +  6  . 


Figure  1 

Thus,  if  u  is  a  random  variable  with  finite  expectation, 

+ 

for  some  0  <  0(6)  <1  by  the  mean  value  theorem.  In  other  words, 

(8)  Eu(ju-(a+S)|  -  |u-aQ  «  e[P(u  <  a+e)  -  P(u  >  a+e)  -  2Q(6)P(a  <  u  <  a+e)], 


I  **  «  *■  ^  - - - -  - — r 

Eu^|u-(a+e)|  -  |u-a|^  =  e[P(u  <  a+6)  -  P(u  >  a+e)] 


6+2a-2  ^a+e0(e)^ 


P(a<  u 


<  a+e) 
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But 


h(X+§)  -  h(X)  -  cT5  +  aTE  (jb  -  AX  -  Ag|  -  |b  -  Ax|^  , 


so  if  we  use  (8)  we  get,  using  P(b  >  AX)  to  denote  the  vector  whose  components  are 
P(bi  >  aix) , 

(9)  h(X+§)  -  h(X)  «  cT5  +  aTD(Ag) 


j^P  ^  b  <  A(X  +  5)  -  P(b  >  A(X+g)) 

-  2D  ^0  (|Ag|)  P(AX  <  b  <  A(X+g)^ 


where  D(y)  denotes  the  diagonal  matrix  whose  diagonal  consists  of  the  components 
of  the  vector  y  and  where  0(|Ag|)  e  ^0^(|a^gj),  0m(|amg|)^  with 

0  <  ©id®1?!)  <  I-  Thus  we  have  an  expression  for  the  increment  of  h(X),  and 
thereby  an  expression  for  any  possible  directional  variation,  in  terms  of  the 
probabilities  of  various  events.  Clearly  then,  any  conditions  on  the  probability 
distributions  involved  in  b  which  guarantee  that  P  (AX  <b  <  A(X+£)) — >0  as 
1 1  | — b0  will  guarantee  the  existence  of  a  gradient  of  h(X)  at  X. 

We  now  specialize  (9)  as  follows:  In  (9)  replace  X  by  tX  and  g  by  GX. 
Then  we  get 


h(t+6)X  -  h(tX)  »  cT  (6X)  +  aTD(A6X) 


-2D  ^0(|A6X|)^  P  (AtX  <  b  <  A(t+e)xjj  «=  6^cTX  +  aTD(AX)  Jp  ^ 

-P^b  >  (t+6)AX^  -  2D^©(|Ax|)^P^tAX  <  b  <  (t+G)AX^J^  . 


[F(b  <  A(t+e)x^  -  p  ^b  >  A(t+e)x^) 


b  <  (t+e)AX^ 


Then  as  t-xx>  we  get,  for  any  fixed  6  >  0, 


(10) 


f(t+e>x') 


h  (tX  ) 


cTx  +  aT|Ax|  . 


Thus,  if  the  left  hand  side  of  (10)  has  a  limit  as  e— >"0,  we  see  that  the  directional 
derivative  "  h(tX)  is  given  by 

(11)  33  h(tx)  -  cTX  +  aT|AX|  . 

It  is  clear  that  computational  methods  can  be  based  on  our  expressions  (9),  (10) 
and  (11),  but  we  shall  reserve  these  developments  for  another  occasion. 
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4 .  Extensions 

The  special  model  treated  in  [1]  is  rarely  of  any  real-world  or  economic- 
theoretical  significance  because  many  constraints  cannot  be  expressed  adequately 
by  "linear"  penalty  functions.  As  a  simple  reminder,  note  that  X  must  be 
bounded,  although  of  course  the  specification  of  the  bounds  may  involve  inter¬ 
relations  between  groups  of  the  individual  variables.  We  have  chosen  to  develop 
our  results  for  clarity  and  ease  of  comparison  in  the  context  of  [1].  However, 
it  should  be  obvious  on  reflection  that  practically  all  the  developments  of  the 
preceding  sections  can  be  extended  to  the  case  where  there  are  additional  linear 
inequality  constraints  on  X  in  (2). 

For  example,  consider  the  extension  of  theorem  3  to  the  case  where  X  must 
also  satisfy  DX  >  d.  Then  our  proof  of  theorem  3  requires  only  the  obvious 
modification  of  the  dual  problem.  Thus  we  get 


Theorem  8 ;  if  the  constraints  DX  >  d,  X  >  0  are  consistent,  the  optimal  value 
of  the  objective  function  for  the  problem 


min  cTX  +  aTE|b  -  Ax| 
subject  to  DX  >  d 
X  >  0 

is  finite  if  and  only  if  there  exist  vectors  w  and  v  satisfying 


T  T 
-w  A  +  v  D 


|w|  <  a 

v  >  0  . 

A  much  more  significant  extension  of  the  general  model  follows  from  observing 
that  the  linear  constraints  DX  >  d  can  be  considered  to  be  the  deterministic 
equivalent  constraints  for  chance  constraints  P(DX  <  b)  >  p.  This  follows  from 
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the  fact  that  since  X  is  a  zero  order  rule,  the  chance  constraints  can  be  re¬ 
placed  by  the  equivalent  set  of  deterministic  constraints  DX  <  F  ^(1-J3),  where 
F  ^(1-p)  is  the  vector  of  F^(l-f3^),  the  (1-0  )  fractile  point  of  the  marginal 
distribution  of  b^. 

It  is  also  evident  that  modifying  the  objective  function  to  the  form 


m 

min  c  X  +  EjGb  -  Ax| , 


where  G  is  a  given  mxm  matrix,  does  not  affect  the  proof  of  our  theorems. 

Thus  our  results  hold  for  the  very  general  class  of  constra ined  generalized  median 
models  discussed  in  [A]. 

Finally >  it  should  be  noted  that  the  so-called  "complete"  problem!/  0f 

linear  programming  under  uncertainty  is  merely  another  special  instance  of  the 

constrained  generalized  median  problem,  and  as  such  falls  under  our  and  the  previous 
analysis  in  ;_4j. 

To  see  this  we  merely  observe  that  the"  complete"  problem  can  be  written  as 

T  /m 

min  c  X  +  E  [  Eg  (X,b) 

V"1 

s.t .  D  X  -  d 
X  >  0 

where  gi(X,b)  =  "  a*X)y^  if  b^,  -  a*X  <  0 


(bi  -  a  X)6i 


if  bt  -  a  X  >  0. 


This  formulation  is  obtained  by  expressing  the  second  stage  decision  variables 
in  terms  of  the  first  stage  decision  variables  X. 


—See  [8], page  102. 

"Completely  slacked"  might  be  more  appropriate  since  'complete'  implies  generality 
rather  than  the  speciality  actually  involved. 
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